m 



% 



April 29, 2013 



Upper bound of typical ranks of 
mxnx ((m — \)n — 1) tensors over the real 

2 ' number field 

o 

<N. 

vh ■ Toshio Sumi, Toshio Sakata and Mitsuhiro Miyazaki 

< 

Abstract 

"^ ■ Let 3 < m < n. We study typical ranks of m x n x ((m — l)n — 1) tensors over 

Ph the real number field. The number (m — \)n — 1 is a minimal typical rank of m x 

« x ((m — l)n — 1) tensors over the real number field. We show that a typical rank 

ofmx/ix ((m — l)n — 1) tensors over the real number field is less than or equal to 

{m — \)n and in particular, m X n X {{m — l)n— 1) tensors over the real number field 

has two typical ranks (m — l)n— 1, (m — l)nif m < p(«), where p is the Hurwitz- 

Radon function defined as p(n) = 2 h + 8c for nonnegative integers a,b,c such that 

n = (2a + l)2 fo+4c and < b < 4. 
O 

r- : 1 Introduction 

Kolda and Bader introduced many applications of tensor decomposition analysis in 
various fields such as signal processing, computer vision, data mining, and others. Ten- 
sor decomposition concerns with its rank and approximation of tensor decomposition 
concerns with typical ranks. In this paper we discuss the typical rank for 3-way arrays 
(3-tensors). A 3-way array 

Wjk)l<i<m, l<j<n, \<k<p 

with size (m, n, p) is called an m x nx p tensor. An m x nx p tensor of form 

{xiyjZk)\<i<m, \<j<n, \<k<p 

is called a rank one tensor. A rank of a tensor T, denoted by rank J 1 , is defined as the 
minimal number of rank one tensors which describe T as a sum. The rank depends on the 
base field. 

Throughout this paper, we assume that the base field is the real number field E. Let 
j^mxnxp k e ^ se t of m x n x p tensors with Euclidean topology. A number r is a typical 
rank of mxnx p tensors if the set of tensors with rank r contains a nonempty open semi- 
algebraic set of W nxnx P (see [HI). We denote by typical_rankR(m, n,p) the set of typical 
ranks of R' nxnx P. Note that 

typical_rankK(/Mi,m2,m3) = typical_rankR(m ! -, m ; -,m^) 




for any i,j,k with {i,j,k} = {1,2,3}. If s and t are typical ranks of tensors with s < t, 
then u is also a typical rank of tensors for any u with s < u <t. The minimal number of 
typical_rankR(m, n,p) is equal to the generic rank grank(m,n,/?) of the set of m x n x p 
tensors over the complex number field [OQ. we denote by mtrank (m, n,p) by the maximal 
typical rank ofR mxnxp . Then 

typical_rankR(m,n,p) = [grank(m,n,jc), mtrank (m,n,p)] flZ. 

However, it is only known that one or two typical ranks of tensors. 

For m = 1 , the rank of 1 xnx p tensor is its matrix rank and therefore the set of typical 
ranks of 1 x nx p tensors consists of one number min(n,p). In the case where m = 2, the 
set of typical ranks of 2 xnx p tensors is well-known A3 : 



typical _rankR(2, n, p) 



Suppose that 3 < m < n. The typical rank of W nxnxp is quite different from that of 
M. 2xnxp . Let p{n) be the Hurwitz-Radon number, that is, p(n) = 2 b + 8c for nonnegative 
integers a,Z?,c such that n = (2a + l)2 z ' +4c and < b < 4. If p > (m — \)n then the set 
of typical ranks of m x n x p tensors is just {mm(p,mn)}. For p = (m — l)n, the set of 
typical ranks of mx nx p tensor is {p} (resp. {p,p + 1}) if and only if m > p(n) (resp. 
m < p(n)). 

The purpose of this paper is to give an upper bound of typical ranks of mx nx ((m — 
l)n— 1) tensors. 

Theorem 1.1 Let 3 < m < n and p = (m—\)n — \. A typical rank ofm xnx p tensors is 
less than or equal to p + 1. In particular, typical_rankR(m, n, p) is a subset of {p, p + 1 }. 

By [[3] Theorem 1.1] we directly have the following proposition. 

Proposition 1.2 Let m < n. Suppose that 3 < m < p(n) or that both m and n are congru- 
ent to 3 modulo 4. Then 

typical_rankR(m,n, (m— l)n — 1) = {(m—l)n— 1, (m— l)n}. 

2 A proof 

In this section, we show the proof of Theorem ll.il 
First, we establish terminology. 

Notation 2.1 (1) For an mx n matrix M, we denote the i x j matrix consisting of the 
first i rows and the first j columns ofM by M< 1 -. 

(2) For anmxn matrix M, we denote the j-th column vector ofM by M = j. 



(3) For a square matrix M, we denote the determinant ofM by \M\. 

(4) For a tensor T = (fyjfc)i<«<m, i</<«, i<k< P , we denote it by(T\\...\ T p ), where T k = 
(tijk) l <i<m, i<j<nfork=l,...,pis anmxn matrix. 

(5) For a vector c = (ci,...,c„) T E W, we denote the Euclidean norm of c by \\c\\, 
that is, \\c\\ = J'Ek=i c k- 



Proposition 2.2 Let M(m,n,p;r) := {T E W nxnxp | rank T < r} and x be a canonical 
map from R' nxnx P onto ]R'" x " x (p-i) which sends (Y 1 ;...;Y p _ 1 ;Yp) to (Y 1 ;...;Y p - 1 ). If 
the set t(£%(m,n,p;r)) is a dense subset of W nxnx ^ p ~\ then mtrank(m,n,p— 1) < r. 

Proof Since x{M{m, n, p; r) ) is a dense, semi-algebraic set, its interior is an open, dense 
semi-algebraic set and thus a Zariski open set. Therefore, mtrank(m,n,p — 1) < r fol- 
lows. I 

Let 3 < m < n, po = (m— l)n, mdp = Pq — 1. We want to show that mtrank(m,n,/?) < 
Pq. To do this, we show that there are a dense subset U of R mx,7X /> and a section s : U — > 
ygmxnxpo sac \ Y fa a t ranker) < po for any tensor T of U . Then, by Proposition I2.2L we 
conclude that mtrank(m,n,p) < pq. 

% A 2 N 



Let W be the set consisting of I "* '" z I such that A i is an (n — 1) x (n — 1) matrix and 

\A 3 A 4 J 

has distinct eigenvalues, P is a nonsingular matrix so that F ' A\P is a diagonal matrix, 
and each element of P ! A 2 is nonzero. 

Let flj : R«ixm 2 xm 3 _> r im3xm 2 be a bi j ection defined as 



(Ai;A 2 ;...;A OT3 )h- 



/Ai\ 

A 2 

\Am 3 J 



and fl 2 : M m > X '"2 X '«3 _+ ^ ra ' xm 2 m 3 be a bijection defined as 

(Ai;A 2 ; . . . ;A m ) H- (Ai,A 2 , . . . ,A m ). 



For (Xi; . . . ;X m ) E R" x /? xm , we put 



,T 



, and 



\^m- 1 / 



(Z 1 ;...;Z m _ 1 )=fl 2 1 (X ra A- 1 ,0)GR" !< "» x ('"- 1 ). 



Now suppose that m > 3. Let T be the subset of M nx P xm consisting of (Xi;...;X m ) 



satisfying the following conditions: 



|A|#0. (1) 

l(^i-i)g:!l #o. (2) 

All eigenvalues of (Z m _i)^"z\ are distinct. (3) 

Zt G W for 1 < k < m - 2. (4) 

m— 1 

/ , x k^k Xm.E'n 
k=\ 



is irreducible. (5) 



If \Y!£=i x k%k ~ x m E n \ is irreducible, then so is \Y!^=i X A — x mE n \ for any Z m _i. 
Since m > 3, the set 1 is a nonempty Zariski open set. 
We consider the following two maps: 

/:Qj 1 -^R»x»x(»-i). / (y 1 ;...;y m ) = y m ( fll (y 1 ;... ; y m _ 1 ))-i, 

/A N 

g . R nxpxm _+ R nxp xm. g ^ ;> _ _ .^ _ fl -l fe T j 

Urn 0, 



where 

Then 

and more generally 



QJi := {(y i; ... ; y ra ) GM" x « ,xm | |fli(n;...;^-i)| t^o}. 

/og(Xi;...;X m ) = (X,„A- 1 ,0) 



A N 

/(fir 1 6 T 1 ]) = ((X m -cb T )A- 1 ,c 
\X m c , 

for(X 1 ;...;X,„)Gg- 1 (QJ 1 ). 

Now, we fix {Xi ; . . . ;X OT _ j ) G T. Putting (Zi ; . . . ; Z OT _ j ) = (X,„A~ ! , 0) , conditions ©- 
© hold. Since the characteristic polynomial |Z m _i — A£„| is divisible by X but not by 
A 2 , we have (Zi; . . . ;Z ra _i) G <£, where 

m— 1 
£ = {(Y i; . . . ;y m ) G R^x^C'"- 1 ) | | £ a k Y k - a m E n \ < for some (a h . . . ,a m ) T G R' n }. 

k=\ 

Therefore, fog(%) C <£. In the previous paper [J4J, we showed that rankX = p$ for any 
X G 9Ji with /(X) G £n QU 2 , where 

2H 2 :={Z=(Z 1 ;...;Z m _ 1 )GM" x " x ( m - 1 )| 

m— 1 

Zk<EW for each 1 < & < m — 1, | V XkZk—x m E n \ is irreducible.}. 

ik=l 



For any ceW 1 with sufficiently small \\c\\ and {Z\\ . . . ;Z m -\) = ((X m — cb T )A~ l ,c), 
the conditions (OQ)-© hold. In addition, since £ is open, there exists c such that Z m _i G W 
and (Z\ ; . . . ;Z m _i) G <£fl 2B2. Therefore, we have 



A N 

rank(Xi;...;X OT _i) ^rankfl^l b T 1 

^ Aw c 



PO- 



We complete the proof of the following theorem. 
Theorem 2.3 Let A<m<n. 

typical_rankR(m,ft, (m— l)n — 1) = {(m— 1)« — 1} or {(m— l)n— 1, (m— l)n}. 

In the case when m = 3, the condition © must be replaced as the condition that 



m— 1 

/ , %k^k ^mt^n 
k=\ 



is irreducible. 



(6) 



We show that the replacement is possible. 

Theorem 2.4 Let 3 = m<n. 

typical_rankR(m,n, (m— l)n — 1) = {(m— l)n — 1} or {{m— l)n— l,(m— l)ft}. 

Proof Note that the n-ih. column (Z,„_i) = „ of Z m _i is zero. Then H l Z m \H is equal 
to 

/ ••• 0\ 

-1 ••• v 2 



*2 



} 



\o ■■• -1 v ;3 y 

for some nonsingular matrix H. Let P be a real vector space of dimension n(n + 3)/2— 1 
with basis 

{xfx|*3 I < a, #, c < n, a + b + c = n, b, c ^ n} 

and S be the set defined as 



S := {(YvJi) e 



niixnxl 



Yl 



(u\\ 

"21 "22 

\"ni ■ ■ ■ 



"ll\ 



*n-l,l "nl/ 



} 



which is isomorphic to a vector space of dimension n[n + 3) /2 — 1 . Let g be a map from 
5 to P defined as 

g((Yv,Y2)) = \x1Y1 +x 2 Y 2 +x 3 E n \ -x'l 



Note that the polynomial © is irreducible if and only if G((Z\\Z2)) is irreducible. Now 
we show that the Jacobian of G is nonzero. 

Suppose that for constants c(vj), c(uij), the linear equation 



j=2 OV J \<j<i<n OU 'J 



(7) 



holds. We show that all of c(vj), c(ujj) are zero by induction on n. It is easy to see that 
the assertion holds in the case where n = 1. As the induction assumption, we assume that 
the assertion holds in the case where n — 1 instead of n. We put 

b 

Xj = UjjX\ +xt, and n(a,b) = Y\^t- 

t=a 

After a partial derivation, we put uu = (i > j) and then have the following equations: 



If = *r ;+ V(u-i: 



dVj 



du\\ 



_dg_ 

du jj 



dg_ 
dun 



(2<j<n) 



x\ 



-xi X 3 



^V2+1)X2 
V 3 X 2 



xiH(l,j-l] 



—X2 Ki-\ Vn-\X2 

-x 2 X n + v n x 2 

Xj+\ Vj+\X2 

~X2 Xj +2 Vj +2 X 2 



—Xi V-l V n -\X2 

~X 2 X n + v n x 2 

X\ U\\X\ 

-x 2 X 2 v 2 x 2 



-x x x n 2 l ^i(j+l,i-l] 



[2<j< n) 



-X 2 Xj-\ Vj-\X2 
-X 2 VjX 2 

By seeing terms divisible by X\ in the left hand side of ©, we have 

dg 



(l<j<i<n) 



E c ( v ;)^-+ £ c(u tJ )hij = 

ov .i 2<j<i<n 



7=2 



where 



h i j = -xxx n 2 l [l(j+l,i-l) 



Ai 











~X2 


h 






v 2 x 2 






-X2 


-X2 


Vj-\X 2 
VjX 2 



Note that 

P- = Mp~ (2<j<n), and 

dVj dVj 

3 — = A13 — (2<j<z<n) 

OUij OUij 

where g' is the determinant of the (n— 1) x (n— 1) matrix obtained from ^iYi + Jt2^2 + 
j^i^ by removing the first row and the first column minus x 1 ^ . Therefore we have 

c(vj) = c(uij) =0 (2 < j < i < n) 

dg' dg' 
since 3 — , 3 — (2 < j < i < n) axe linearly independent by [4, Lemma 5.2]. By ©, we 

OVj OUij 

have 

c{u n )^--i\c{ua)u n x\x n 2 - i pi{2,i-\)=Q. (8) 

du\\ r- 

By expanding at the n-th column, we have 

3-2- = (v 2 + l)xi4 _1 + E v i -jci4~ ,+ V(2,i- 1) +xi(K + v n x 2 )n(2,n-l) 
and then the equation © implies that 

n 

(c(un)(v2 + l)x2-c(u2i)xi)xix'2~ 2 + Y,(c(un)viX2- c(un)xi)xiX2 ~'n(2,i-\) 
+ (c(Mn)(A w + v B x 2 )-c(H n i)wiixi)xijU(2,n-l) =0. 

By seeing the coefficient oixxx^ , we have c{u\ \ ) — 0. Further, by seeing the coefficients 
corresponding to x^, < s < n — 2 in the equation ([8]), we have c(w,i) = for 2 < 1 < n. 

Therefore, we conclude that 3 — , 3 — are linearly independent, which means that the 

OVj OUij 

Jacobian of g is nonzero. 

Therefore the set of (Z\ , . . . , Z m _ i) eM" xp such that (Z,„_ 1 ) =n = and the polynomial 
© is irreducible is a Zariski open set. Hence, the condition © is replaced with ©. I 
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